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[57] ABSTRACT 

A method and apparatus for processing block coded 
image data wherein each block comprises a plurality of 
pixels. A local pixel is selected from a first block of 
pixels. The selected pixel is preferably near a border 
between the first block of pixels and a second block of 
pixels. At least one external pixel is selected from the 
second block of pixels. The selected external pixel(s) is 
(are) also near the border. The selected local pixel is 
modified to reduce the difference between the local 
pixel and the selected external pixel(s). The selected 
pixel value is modified as follows. A low pass filter 
coefficient is selected for each selected local pixel value 
and for each selected external pixel value. The selected 
local pixel value and the external pixel values are each 
multiplied by their corresponding low pass filter coeffi- 
cient. The products of these multiplications are summed 
together to form a low pass filtered pixel value. 

7 Claims, 11 Drawing Sheets 
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METHOD AND APPARATUS FOR PROCESSING 

BLOCK CODED IMAGE DATA TO REDUCE 
BOUNDARY ARTEFACTS BETWEEN ADJACENT 

IMAGE BLOCKS 5 

BACKGROUND OF THE INVENTION 

The invention relates to processing block coded 
image data. The Consultative Committee for Interna- 1Q 
tional Telephony and Telegraph (CCITT) has adopted 
a standard (H.261) for encoding image data representa- 
tive of a sequence of two dimensional arrays of image 
data. According to the proposed standard, a two dimen- 
sional array of pixel data is divided into a plurality of 15 
blocks, each block including an 8x8 sub-array. Each 
block of data is encoded using a lossy encoding tech- 
nique to reduce the number of bits required to represent 
the block. The encoded data is then transmitted to a 
remote device which reconstructs the entire image from 20 
the transmitted data. 

The image reconstructed from the encoded blocks 
does not perfectly correspond to the original image. In 
each block of data, image information is lost when the 
data is compressed to reduce the number of bits for 25 
transmission. Since each block is separately coded, the 
losses in one block differ from those of adjacent blocks. 
As a result, a noticeable line appears at the boundaries 
between the blocks. 

One object of the invention is to process the pixels 30 
near the boundaries between adjacent blocks to reduce 
or eliminate the noticeable boundary caused by block 
encoding. Another object of the invention is to effi- 
ciently examine the pixel data near the borders between 
blocks to determine if the image includes edges in the 
vicinity of the border. If such edges are detected, the 
pixels near the border are processed to reduce the cod- 
ing artifacts caused by block encoding without remov- 
ing or distorting edges which appear in the image. 
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SUMMARY OF THE INVENTION 



The invention relates generally to a method and ap- 
paratus for processing block coded image data wherein 
each block comprises a plurality of pixels. A local pixel 4J 
is selected from a first block of pixels. The selected pixel 
is preferably near a border between the first block of 
pixels and a second block of pixels. At least one external 
pixel is selected from the second block of pixels. The 
selected external pixel(s) is (are) also near the border. 50 
The selected local pixel is modified to reduce the differ- 
ence between the local pixel and the selected external 
pixel(s). 

In preferred embodiments, the selected pixel value is 
modified as follows. A low pass filter coefficient is 55 
selected for each selected local pixel value and for each 
selected external pixel value. The selected local pixel 
value and the external pixel values are each multiplied 
by their corresponding low pass filter coefficient The 
products of these multiplications are summed together 60 
to form a low pass filtered pixel value. 

Similarly, an all pass filter coefficient is selected for 
each selected local pixel value and for each external 
pixel value. The selected local pixel value and the exter- 
nal pixel values are each multiplied by their correspond- 65 
ing selected all pass filter coefficient The products of 
these multiplications are summed together to form an all 
pass filtered pixel value. The all pass filtered pixel value 



and the low pass filtered pixel value are combined to 
form a smoothed pixel value. 

The above described processing is performed on 
block encoded data. To appreciate further aspects of the 
invention, it must be noted that the block encoded data 
is derived from an original block of image data which is 
quantized to reduce the number of bits required to rep- 
resent the original block of image data. In another as- 
pect of the invention, the magnitude of this quantization 
step size is used in processing the blockcoded image 
data. More specifically, to combine the filtered pixel 
values, a proportionality factor is first selected based on 
the quantization step size. A weighted sum of the all 
pass filtered pixel value and the low pass filtered pixel 
value is then computed to form a smoothed pixel value, 
wherein the proportionality factor specifies the relative 
weight accorded to each filtered pixel value. 

In another aspect, the invention relates to detecting 
the approximate direction of edges, if any, in the vicin- 
ity of the border. Based on the detected direction of any 
such edges, the external pixels are selected such that 
they form a line with the local pixel which extends in 
the detected direction. 

To detect the approximate direction of such edges, a 
first gradient value is computed which represents the 
average difference between at least one pair of local 
border pixels (Le., in the vicinity of the border) which 
form a line in a first direction. 

A second gradient value is computed which repre- 
sents the average difference between at least two local 
border pixels which form a line in a second direction. 
The smaller of the two gradients are selected. The di- 
rection in which the smaller gradient was computed is 
chosen as the approximately direction. 

In preferred embodiments, the first direction forms 
approximately a forty-five degree angle with the bor- 
der, and the second direction forms approximately a 
one hundred and thirty-five degree angle with the bor- 
der. In such embodiments, a third, gradient value is 
computed which represents the average difference be- 
tween a plurality of local border pixels which form a 
line at approximately a ninety degree angle with the 
border. 

A bias factor is subtracted from the third gradient 
value to form a biased gradient value. The smallest of 
the first, second, and biased gradients is selected. The 
direction of the smallest gradient is chosen as the ap- 
proximate direction for smoothing. However, if the first 
gfif3 second gradients are equal, the biased gradient is 
selected and the direction of the biased gradient is 
chosen as the direction for smoothing. 

Other objects, features and advantages of the inven- 
tion are apparent from the following description of 
particular preferred embodiments taken together with 
the drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1(a) is a block diagram of a transmitter for en- 
coding image data using a block encoder. 

FIG. 1(b) is a block diagram of a receiver for decod- 
ing image data received from the transmitter to repro- 
duce the image. 

FIG. 2 is a diagram illustrating the operation of a 
discrete cosine transform. 

FIG. 3 is a diagram illustrating the boundaries be- 
tween the adjacent blocks of image data. 

FIG. 4 is a block diagram illustrating four columns of 
pixels surrounding a border between adjacent blocks. 
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FIG. 5 is a block diagram of a seam filter. 

FIG. 6 is a flow chart illustrating the procedure for 
selecting characteristics of the seam filter. 

FIGS 7(a) and 7(b) are diagrams illustrating the rela- 
tionship between a proportionality factor and a quanti- 5 
zation step size. 

FIGS. 8(a) and 8(b) are diagrams illustrating an image 
line in the vicinity of a border between adjacent blocks. 

FIGS. 9(a)-9(c) are diagrams illustrating a pairing of 
pixels at 90", 45* and 135" respectively io 

FIG. 10 is a flow chart of a procedure for selecting a 
direction for smoothing border pixels. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

I. System Overview 

Referring to FIGS. 1(a) and 1(b), a transmitter 10 
encodes image data representative of an image 12 and 
transmits the encoded image data to a receiver 37 which 
reconstructs the image and displays it at a remote loca- 20 
tion. Image 12 consists of luminance and chroma com- 
ponents. However, for purposes of the following discus- 
sion, only the luminance components is described. 

The transmitter 10 separates the image into an array 
of macroblocks 38 wherein each rnacroblock includes a 25 
16x16 sub-array of pixel data. Each rnacroblock is 
further divided into four blocks 39 each including an 
8x8 sub-array of pixel data. 

The transmitter is typically capable of encoding each 
block of data using a variety of encoding techniques. 30 
For each rnacroblock of data, the transmitter selects an 
encoding technique which requires the fewest number 
of bits to describe the rnacroblock of data. 

One class of such techniques is referred to as "inter- 
frame" encoding. Interframe encoding techniques de- 35 
fine each block of image data in terms of the differences 
between the block of data and a reference block of data. 
The transmitter transmits the difference information to 
the receiver. Since the receiver maintains copies of the 
references images, it can reconstruct the block of data 40 
by combining the difference information with the refer- 
ence image. 

Another technique is referred to as "intraframe" en- 
coding. According to this technique, the transmitter 
simply transmits the original block of data to the re- 45 
ceiver. In effect, intraframe encoding describes each 
block of data in terms of the differences between the 
block of data and a zeroed reference block in which 
each pixel equals zero. 

Finally, the transmitter may send no information 50 
regarding the block of data. This implies to the receiver 
that the corresponding block for the last frame should 
be used as the block for the current frame. 

One interframe encoding technique uses the most 
recently transmitted frame as a reference. As shown in 55 
FIG. 1(a), the transmitter includes a reconstruction 
module 20 which reconstructs each frame of the se- 
quence of images from the transmitter's own transmis- 
sion signal T in a manner similar to the reconstruction 
performed at the receiver. The transmitter stores the 60 
reconstructed image in a reconstructed frame reference 
memory 22. . 

For each block of pixel data P(ij), a subtracter 13 
calculates the difference between each pixel P(i j) of the 
block and a corresponding pixel l&j) in the recon- 65 
structed frame. The resultant, error signal e/(ij) is pro- 
vided to an encode selector 15 for determining whether 
e^i j) is a more efficient representation of the block of 
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data than the other encoded representations described 
below. 

Another interframe encoding technique prepares, for 
each block to be transmitted, a warped image reference. 
Toward this end* a motion compensation module 23 
searches for an 8X8 block of data M(ij) in the recon- 
structed image 22 which closely matches the block to be 
coded. A loop filter 8 typicaUy filters the selected block. 
However, the filtered output M/ij) is only used if it 
more closely matches the pixel data P(ij) than the unfil- 
tered version M(ij). The selected block of data (M(ij) 
or M/ij)) is stored in a warped image reference mem- 
ory 24 for use as a reference W(i j) in encoding the 
block. 

A second subtractor 14 subtracts each pixel P(i j) of 
the block to be coded from the corresponding pixel 
w(i j) of the warped block. The resultant error signal 
e2(ij) therefore represents the block in terms of the 
difference between the original block and the warped 
reference block. Since the receiver can prepare the 
same warped reference block, it can reconstruct the 
original block by combining the error signal ei(hj) and 
the warped reference w(ij). The error signal e2(i j) is 
supplied to the encode selector for comparison with the 
other encoded representations of the block. 

Other interframe encoding techniques are well 
known to those skilled in the art However, the above 
techniques are used as examples to illustrate the opera- 
tion of the invention. 

Finally, for purposes of intraframe encoding, the 
original pixel data P(i j) for the block is supplied to the 
encode selector. For each rnacroblock, the encode se- 
lector determines whether to a) transmit the blocks 
within the rnacroblock as represented by one of the 
above described forms of encoding, or b) send no infor- 
mation regarding the block thereby instructing the re- 
ceiver to repeat the same block from the previous 
frame. For purposes of describing the further process- 
ing of each block, the error signal selected by the en- 
code selector is referred to as pixel error data E(ij). 

Each selected 8X8 block of pixel error data E0j) is 
supplied to a two dimensional discrete cosine transform 
module (DCT) 16 which converts the 8X8 array of 
pixel error data E(ij)into an 8x8 array of transform 
coefficients C(u,v). (See FIG. 2) As is known to those 
well skilled in the art, the DCT transform is related to 
the Discrete Fourier Transform (DFT). Accordingly, 
the two dimensional array of discrete transform coeffi- 
cients C(u,v) represents the two dimensional "spatial 
frequencies'* within the block of pixel error data. The 
discrete cosine transform coefficient C(l,l) in the upper 
left hand comer of the coefficient array represents the 
DC component of the array of pixel error data. The 
remaining coefficients are referred to as the "AC coeffi- 
cients". Each AC coefficient represents a spacial fre- 
quency component of the block of pixel error data. 

The array of DCT coefficients is supplied to a quan- 
tizer 17 which quantizes each coefficient by dividing 
the coefficient by a selected quantization step size. The 
quotient is rounded to the nearest integer to form a 
quantized coefficient C^u,v). Accordingly, the quan- 
tized coefficients represent the array of DCT coeffici- 
ents using fewer bits than the original DCT coefficients. 
The magnitude of step sizes used to quantize the coeffi- 
cients is therefore chosen to control the number of bits 
required to represent the array. Preferably, the step size 
is chosen such that the quantized coefficients represent 
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the original coefficients as accurately as possible using data. Accordingly, even if two adjacent blocks use the 
the number of bits allocated for. transmission of the ' exact same quantization step size the resultant pixel 

image data. quantization errors in one block are not necessarily the 

Each quantized coefficient Cg(u,v) is supplied to an same as those in an adjacent block. Further, each block 

encoder 18 which further encodes the quantized coeffi- 5 .may have a different quantization step size. Coefficients 

cients and transmits the encoded coefficients C*and the which are coarsely quantized are likely to have corre- 

selected quantization step size S q to the receiver 37. spondingly large pixel quantization errors. Thus, if a 

Referring to FIG. 1(6), the receiver includes a de- first block is coarsely quantized and its neighboring 

coder 25 which decodes the coefficients C e to repro- block is finely quantized, the pixels on either side of the 

duce the quantized coefficients Cg(u,v). Because, the 10 border between the blocks will likely have dramatically 

encoder 18 and decoder 25 are lossless, the quantized different pixel quantization errors, 

coefficients C^v) reproduced by the decoder 25 are Referring again to FIG. 1(b), the receiver includes a 

identical to those generated by the transmitter's quan- seam filter 35 for processing the reconstructed pixel 

tizer 17, in the absence of transmission error. data F(ij) to reduce the noticeable boundaries caused 

An inverse quantizer 26 multiplies each quantized IS by block encoding. The seam filter 35 processes each 

coefficient C^(u,v) by the received step size S q to pro- pixel along the borders of each block ("border pixels") 

duce the received coefficients C(u,v). The received to reduce the disparity between the border pixels and 

coefficients differ from the original coefficients C(u,v) neighboring pixels within adjacent blocks. As shown in 

due to the rounding operation performed by the trans- fig. 3, the border pixels consist of outer boundary 

mitter. The error introduced by this rounding operation 20 puds 5g which directly border the adjacent blocks 

is referred to as the "quantization error". 42-56, and inner boundary pixels 59 adjacent to the 

The received coefficients C(u,v) are supplied to an outer boundary pixels 58. To illustrate the operation of 

inverse DCT module 28 which converts the received seam filter 30, the following describes the smoothing of 

coefficients back to an 8x8 array of pixel error data an outer boundary pixel 72 near a border 60 between 

E'(ij). A reconstruction module 28 reconstructs the 25 blocks. 40 and 46 (FIG. 4). 

pixel data F(i j) data from the pixel error data E'(i j). The pixels within the image 12 are arranged in col- 
More specifically, if intraframe encoding was used, a mmSm shown in FIG. 4, to smooth pixel 72, filter 30 
decode selector 31 treats the pixel error signal E'(ij) as selects a pixel from column A to the left of pixel 72, and 
the reconstructed pixel data F(ij) without further pro- a from ^ ch 0 f the two columns C, D to the right 
cessing. If interframe encoding was employed, the re- 30 of 72 ( e g ^ f rom adjacent block 46). As explained 
construction module combines the error signals E'0j) more f m iy below, the filter replaces pixel 72 with a 
with the appropriate , reference image data to recon- smoothed pixel value derived from the values of pixel 
struct the pixel data. For example, if the previous recon- 72 ^ the three selected pixels, 
structed frame was used as a reference, an adder 29 Xo pixels from each 0 f the neighboring col- 
combines the pixel error data E'(iJ) with the recon- 35 11TT1TK j ^ fflter ^ determines a direction in which 
structed image data P"(iJ) from the previous frame 34 siting is to be performed. For example, to smooth 
to form die reconstructed pmd data F(ij) for the cur- m a direction perpendicular to border 60, the filter se- 
rent frame. If the warped reference was used, a motion lect3 pixels 70> 74| 76 which form a Me perpendicular to 
compaction m^ule 33 prepares a motion compen- ^e To smooth * a 4 5° angle, the filter selects 
sated block MCij). If the motion compensated block 40 pix els 78, 80, 82 which together with pixel 72 form a line 
was filtered at the transmitter, (as indicated by side at a 45 o - e tQ ^ border similarlVj to filter at a 135° 
informabon sent by the transirntter) a ^ filter 6 filters ^ ^ mter kels ^ 86 , 88 which together 
the motion compensated block M (jo) and stores the ^ ^ 72 form a ^ at a 135 - ^ t0 ^ bordcr . 
result as a warped reference W (ij) ma warped refer- M e lained more fully below, the direction of 
encestore32 LA second a^er 30 combmes the ^ 45 h determined by an edge detector which 
error signal E (i j) with the warped reference W (y) to eMmines ^ received pixe]s to locate lines or edges in 
form the reconstructed pixel data P (id). ^ irpflgP For example, if the edge detector locates a 
The reconstructed pixel data P'(i j) is supplied to a Mo QJ ^ flt approxima tely a 45- angle to the border, 
reeonstructed image store 34 for stonng the recon- it ^* 4r ^ ^ desired ^ for soothing, 
structed image. The reconstructed image store also 50 Referring t0 ^ 5f the four selected pixel values 
stores, for each stored block, the quantization step size X(A ^ X(B)j X(C)j ^ X(D) (where ^ letter8 A _ D 
used to encode the stored block. identify the column A-D in which the selected pixel 
Smce the transmitted DCT coefficients differ from resides) are provided to a low pass filter 90 and to an all 

^'ofrlo^S^ l^T^ n°r^ r f>l e 55 1^ filter 92. THe low pass filter computes a weighted 

block of recoiBtructed pixel date F<y) prepared from 55 ^ Xl of the four pixel values according to the folio w- 

the transmitted coefficients differs from the original mg equation: 
block of pixel data P(iJ). For purposes of the following 

discussion, the difference between a given recon- x^z^v^+l^^+^Q+^^W (l) 
structed pixel FQj) and the corresponding original 

pixel PGJ) is referred to a "pixel quantization error." 60 where Li, and I* are weighting coefficients to be 

Referring to FIG. 3, the pixel quantization errors in a described more fully below. Similarly, the all pass filter 

given block 40 may differ from the pixel quantization computes a different weighted sum Xjy according to the 

errors in each of the neighboring blocks 42-56 thereby equation: 
causing noticeable boundaries between the adjacent 

blocks. Several factors contribute to the difference in 65 Xh= fl^*) + # -kffz*( Q + BiX{D) (2) 
pixel quantization errors. First, the quantization is per- 
formed on DCT coefficients which represent the spa- where Hi, H& H3, and H4 are all pass filter coefficients 
cial frequency components of the block of pixel error described more fully below. 
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A combiner 94 combines the filter outputs according 
to the following equation to form the smoothed pixel 
value Xj: 



(3) 5 



where p is a proportionality factor which determines 
the relative weight given to the outputs of the low and 
all pass filters. 

Referring again to FIG. 4, the inner boundary pixel 
70 which is adjacent pixel 72 is smoothed using the same 
selected set of pixel values X(A), X(B), X(C) and X(D) 
and the same proportionality factor p used to smooth 
pixel 72. However, as explained more fully below, the 
filter weighting coefficients L1-L4; and H1-H4 may 
have different values than those used to process outer 
boundary pixels, depending on the desired angle for 
smoothing. 

IL Procedure for Determining the Characteristics of 
the Seam Filter 

Referring to FIG. 6, the following describes the pro- 
cedure for detennining the characteristics of the low 
pass filter, Li, L2, L3, and L4 and the characteristics of 
the all pass filter Hi, H2, H3, and H4 used to process 
border pixels within block 40. The seam filter first de- 
termines if the received DOT coefficients for block 40 
a) were intraframe encoded, and b) include any nonzero 
AC coefficients (Step 110). If the block was intraframe 



10 



IS 



20 



25 



quantization errors. Accordingly, the seam filter per- 
forms substantial smoothing. 

The preferred embodiment conforms to the CCITT 
H.261 standard, which permits thirty-one possible step 
sizes, comprised of the set of even integers {2, 4, 6, . . . 
62}. These step sizes S 9 must be applied to the intraframe 
DCT AC coefficients or to the interframe DCT DC and 
AC coefficients. The intraframe DCT DC coefficients 
use a different, predefined quantizer which is not mate- 
rial to the invention. 

FIG. 1(a) illustrates the value of the proportionality 
factor p for each of the thirty-one possible quantization 
step sizes used to encode the AC coefficients. For step 
sizes equal to or greater than eight, the proportionality 
factor is set equal to one thereby fully disabling the all 
pass filter and enabling the low pass filter. Thus, for step 
sizes equal to or greater than eight, seam filter 30 per- 
forms substantial smoothing. 

A step size of two indicates that the transmitter essen- 
tially did not quantize the coefficients before sending 
them to the receiver except for rounding. The recon- 
structed pixels F(i j) for the block therefore are nearly 
identical to the original pixels P(ij). Thus, for a step size 
of two, the proportionality factor is set equal to zero to 
disable the low pass filter thereby performing no 
smoothing. 

For step sizes between two and eight, the proportion- 
ality factor gradually increases with step size as shown 



encoded using no AC coefficients, the seam filter sets m FIG. 1(a) to gradually increase the degree of smooth 

tV»#» wpialtHno rnpffiripnk fnr tfip> Inu/ nacc utiH all nacc ^ _ _ti_ _ /»_ . *t . • 



the weighting coefficients for the low pass and all pass 
filters as follows. For filtering the outer boundary pix- 
els, it sets the weighting coefficients LI, L2 and L3 of 
the low pass filter equal to 0.2 and sets the weighting 
coefficient L4 equal to 0.4 (Step 112). For the all pass 



ing. More specifically, for these step sizes the ratio of 
the proportionality factor to step size is 1/6. 

Referring again to FIG. 6, if the DCT coefficients 
within block 40 include at least one AC coefficient or if 



„ t • . . . ^ * . ' ~-~ — — * , ic the block was interframe encoded, the seam filter pro- 

filter, it sets the weighting coefficiente HI, H2, and H4 » ceeds to analyze the pixels within block 40 to determine 



equal to zero and the weighting coefficient H3 equal to 
one. (Step 114). 

For filtering the inner boundary pixels, the seam filter 
sets the low pass filter coefficient Li equal to zero, L2 
and L3 equal to 0.2, and L4 equal to 0.6. (Step 116). For 40 
the all pass filter, it sets the weighting coefficients Hi, 
Ha, H3 equal to zero and the coefficient H4 equal to one. 
(Step 118). 

Tne seam filter then determines the proportionality 
factor p according to the procedure described below 45 
(Step 120) and smooths all boundary pixels in a direc- 
tion perpendicular to the boundary. (Step 122). 

HI. Procedure for Determining the Proportionality 

Factor 50 

In the preferred implementation, the low pass filter 
performs substantial smoothing and the all pass filter 
performs no smoothing. Accordingly, if substantial 
smoothing is desired, proportionality factor p is set 
equal to one. If no smoothing is desired, proportionality 55 
factor is set equal to zero thereby disabling the low pass 
filter. If an intermediate degree of smoothing is desired, 
the proportionality factor is set between zero and one to 
select a desired degree of smoothing. 



the preferred direction in which to smooth the pixels. 
(Step 124). The filter selects a desired direction for each 
of the four borders surrounding the block. 

After selecting the desired direction for each border, 
the seam filter compares the number of AC coefficients 
to a threshold Noc which, in the preferred embodiment, 
equals four. (Step 126). If the number of AC coefficients 
is less than the threshold, the seam filter sets the charac- 
teristics of the low pass and all pass filters to the same 
values described above. (Steps 112-118). It proceeds to 
select a proportionality factor based on the quantization 
step size used in quantizing the pixels. (Step 130). How- 
ever, as explained more fully below, the proportionality 
factor p is selected in this case using different criteria. 

FIG. 1(b) illustrates, for this case, the value of the 
proportionality factor for each of the thirty-one possible 
quantization step sizes. For step sizes equal to or greater 
than 32, the proportionality factor is set equal to one 
thereby disabling the all pass filter and enabling the low 
pass filter. For step sizes between two and eight inclu- 
sive, the seam filter sets the proportionality factor equal 
to zero to disable the low pass filter and fully enable the 
all pass filter. For step sizes between eight and thirty- 
The magnitude of the proportionality factor p is de- 60 two, the proportionality factor gradually increases with 



termined based on the quantization step size used in 
quantizing AC coefficients corresponding to block 40. . 
If the coefficients within block 40 are finely quantized, 
the seam filter 30 assumes that the received pixel values 
accurately represent the original image. Therefore little 65 
or no smoothing is performed. However, if the coeffici- 
ents are coarsely quantized, seam filter 30 assumes that 
the pixels near the border 60 may include large pixel 



step size as shown in FIG. 1(b) to gradually increase the 
degree of smoothing. More specifically, for these step 
sizes, the ratio of the proportionality factor to the step 
size is 1/24. 

Referring again to FIG. 6, if the number of nonzero 
AC coefficients is greater than or equal to the threshold 
No* the seam filter selects a different set of characteris- 
tics for the low and all pass filters. More specifically, to 
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process the outer boundary pixels, the low pass filter 

weighting coefficients are set as follows: Li =0, I>2= J. , 7 (5) 

L3=i, and L4=0; and the weighting coefficients for the G*s = w- .g, WO - W+ 01 

all pass filter are set as follows: Hi=H2=H4=0, and 7 2 

H3 is set equal to one. (Step 136). 5 . .._ , . . .. . . , . 

For processing the inner boundary pixels, the „ To calcu ? ate f a 135 "8* f d S e 
weighting coefficients of the low pass filter are set as <^^tor pans a pud from column A with a pixel from 

follows: L, =L 2 =L 3 =0 ( and L4-I; and the weighting ^^J^ *^ 

cc^dentsHuH^andHafortheaUpassffltexareset «^bo«tor JOat* 35 angle as shown m FIG. 9(6). 

equal to 0 and the coefficient H4 is sVequal to one. 10 ?*'T * Bnd 3 Xvea su ° h P**- 

(Step 138). The proportionality factor is then selected detector then computes the average difference between 

using the same criteria shown in FIG. 7(6). (Step 140). ^ ^ of P ads t0 

Based on the selected weighting coefficients and 0W ' 
proportionality factor, the border pixels for each of the 

four borders are filtered in the direction selected for the Gu5 _ l | _ _ ^. <Q 

border. (Step 142). 7 N|7 1=2 

IV. Selection of A Direction for Filtering Each Border , . . , - . ,. ^ - 

0 Based on the relative values of these gradients, the 

The original image 12 (FIG. 1) may include actual 2Q edge detector estimates the direction of any edges 

edges or lines within the vicinity of border 60. For within the vicinity of border 60. A small gradient in a 

example, FIG. 8(a) illustrates an image having a diago- given direction indicates that the pixel values have simi- 

nal line 98 which crosses border 60 at approximately a lar values along that direction. Accordingly, this may 

45* angle. As shown in FIG. 8(6), if the pixels within suggest the presence of an edge along that direction, 

block 40 are smoothed in a direction perpendicular to 2 s Referring to FIG. 10, the edge detector compares the 

the border, the seam filter will distort the diagonal line gradient taken along the 45° angle G45 with the gradient 

in its effort to smooth the block coding artifacts in the taken along the 135° angle G135 (Step 210). If the two 

vicinity of border 60. More specifically, filter 30 light- gradients are equal, the edge detector selects 90° as the 

ens the pixels within the line 98 by averaging these desired direction for filtering (Step 212). If the gradients 

pixels with lighter. pixels from block 46. Similarly, it 30 are not equal, the edge detector selects the smaller of 

darkens light pixels from block 40 by averaging them the 45° gradient and the 135° gradient for comparison 

with dark pixels from the portion of line 98 in adjacent with the 90* gradient G90. (Step 214). For purposes of 

block 46. this comparison, the edge detector subtracts from the 

To eliminate this problem, seam filter 30 includes an 90" gradient a bias factor E (Lc, 2 in the preferred em- 
edge detection mechanism for detecting legitimate lines 35 bodiment) to form a biased 90° gradient G#. (Step 216). 
or edges in the vicinity of the borders between adjacent If neither of the 45° and 135* gradients is less than the 
blocks. 90° biased gradient, the edge detector selects 90° as the 

The following describes the operation of the edge preferred direction for filtering. (Steps 218, 220). Other- 
detector in detecting edges in the vicinity of border 60. wise, the edge detector selects the smaller of the 45° and 
The same process is repeated for each of the tour bor- 40 135* gradients. (Step 222). The angle at which this se- 
ders between block 40 and its neighboring blocks. lected gradient was calculated is used as the preferred 

Referring to FIGS. 9(a)-9(c) block 40 includes two direction for filtering. (Steps 224, 226). 

columns of pixels, A and B, which are adjacent to bor- Additions, subtractions, deletions and other modifica- 

der 60. The edge detector computes a gradient from tions of the preferred particular embodiments of the 

these pixels in each of the three directions, namely 45°, 45 inventions will be apparent to those practiced in the art 

90°, and 135°. To compute the gradient, the edge detec- and are within the scope of the following claims, 

tor computes the average difference between adjacent What is claimed is: 

pixels in columns A and B along each of the three direc- 1. a method for processing reconstructed, previously 

tions. For example, to compute the gradient in the 90* encoded block coded image data wherein each block 

direction, the edge detector computes the difference 50 comprises a plurality of pixels, said block collectively 

between each adjacent pair of pixels in columns A and forming a reconstructed image, the method comprising 

B. (FIG. 9(c)). It then sums the differences and divides the steps of: 

by eight according to the equation shown below: selecting a local pixel from a first reconstructed block 

55 of pixels, said local pixel being near a border be- 

I , (4) tween said first block of pixels and a second recon- 

^° ~ 1 ii 1 |iW TOI structed block of pixels, said second block being 

adjacent said first block, said local pixel having a 

where Po(i) represents a pixel from column A at row i, first pixel value, 

and Pfc(i) represents a pixel from column B at row L 60 selecting at least one external pixel from said second 

To compute the gradient in the 45* direction, the block of pixels, said external pixel having a second 

edge detector pairs a pixel from column A with a pixel pixel value and being near said border, and 

from column B such that a line connecting the paired modifying said selected local pixel to reduce the dif- 

pixels forms a 45* angle with the border 60 as shown in ference between said first pixel value of said local 

FIG. 9(6). Block 40 includes seven such pairs. The edge 65 pixel and said second pixel value of said at least one 

detector then calculates the average difference between external pixel while not modifying pixels of said 

the seven pairs of pixels according to the equation be- first block more distant from said external pixel 

low: than said local pixel. 
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2. A method for processing block coded image data 
wherein each block comprises a plurality of pixels, the 
method comprising the steps of: 

selecting a local pixel from a first block of pixels, said 
local pixel being near a border between said first 5 
block of pixels and a second block of pixels, 

selecting at least one external pixel from said second 
block of pixels, said external pixel being near said 
border, and 

modifying said selected local pixel to reduce the dif- 10 
ference between said first pixel value of said local 
pixel and said at least one externa] pixel, wherein 
modifying said selected pixel value comprises the 
steps of: 

selecting a low pass filter coefficient for each said IS 
selected local pixel value and for each said external 
pixel value, 

multiplying each said selected local pixel value and 
each said external pixel value by said correspond- 
ing selected low pass filter coefficient, 20 

summing the products of said multiplication step to 
form a low pass filtered pixel value, 

selecting an all pass filter coefficient for each said 
selected local pixel value and each said external 
pixel value, 25 

multiplying each said selected local pixel value and 
each said external pixel value by said correspond- 
ing selected all pass filter coefficient, 

summing the products of said multiplication step , to 
form an all pass filtered pixel value, and 30 

combining said all pass filtered pixel value and said 
low pass filtered pixel value to form a smoothed 
pixel value. 

3. The method of claim 2 wherein each said local 
pixel value is quantized with a quantization step size, 35 
and wherein combining said filtered pixel values com- 
prises the steps of: 

selecting a proportionality factor based on said quan- 
tization step size, 

computing a weighted sum of said all pass filtered 40 
pixel value and said low pass filtered pixel value to 
form a smoothed pixel value, wherein said propor- 
tionality factor specifies the relative weight ac- 
corded to each filtered pixel value. 

4. The method of claim 3 wherein computing said 45 
weighted sum comprises the steps of: 

multiplying said low pass filtered pixel value by said 

proportionality factor, 
multiplying said all pass filtered pixel value by one 

minus said proportionality factor, and 50 
summing the products of said multiplication steps to 

form said smoothed pixel value. 

5. The method of claim 1 further comprising the step 
of: 

detecting the approximate direction of edges, if any, 55 
in the vicinity of said border, and wherein selecting 



said at least one external pixel comprises the step 
of: 

selecting at least one external pixel which forms a line 
with said local pixel such that said line extends in 
said detected direction. 

6. A method for processing block coded image data 
wherein each block comprises a plurality of pixels, the 
method comprising the steps of: 

selecting a local pixel from a first block of pixels, said 
local pixel being near a border between said first 
block of pixels and a second block of pixels, 

selecting at least one external pixel from said second 
block of pixels, said external pixel being near said 
border; and 

modifying said selected local pixel to reduce the dif- 
ference between said first pixel value of said local 
pixel and said at least one external pixel, 

detecting the approximate direction of edges, if any, 
in the vicinity of said border, and wherein selecting 
said at least one external pixel comprises the step 
of: 

selecting at least one external pixel which forms a line 
with said local pixel such that said line extends in 
said detected direction, wherein detecting said 
approximate direction comprises the step of: 

computing a first gradient value representative of the 
average difference between at least one pair of 
local border pixels in the vicinity of said border 
such that said at least one pair of pixels defines a 
line in a first direction, 

computing a second gradient value representative of 
the average difference between at least one pair of 
local border pixels in the vicinity of said border 
such that said at least one pair of pixels defines a 
line in a second direction, and 

selecting said first direction as said detected approxi- 
mate direction if said first gradient is less than said 
second gradient 

7. The method of claim 6 wherein said line in said first 
direction forms approximately a forty-five degree angle 
with said border, and wherein said line in said second 
direction forms . approximately a one hundred and 
thirty-five degree angle with said border, and wherein 
said method further comprises the steps of: 

computing a third gradient value representative of 
the average difference between a plurality of local 
border pixels in the vicinity of said border wherein 
each said pair of pixels defines a line in a third 
direction such that said line forms approximately a 
ninety degree angle with said border, 

subtracting a bias factor from said third gradient 
value to form a biased gradient value, and 

selecting said third direction as said detected approxi- 
mate direction if said biased gradient is less than 
said first gradient and said second gradient 
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